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SYSTEM AND METHOD ^^^^^^ 
FOR ENHANCING DYNAMIC RANGE IN IMAGES 



BACKGROUND OF THE INVENTION 
Field of the Invention 
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1 Field of the Invention 

imaging d«i«=. which udhz. cha,g«oup,.d d.v,ce ,CCD, 
imagers, CMOS imagers, or olber types of imagers. 



2 Deseription of ReUted Art 

A-video oanter, typiealiy contains . soUd-state electromc imagrng de^ce ^t* 

.. .CCD (eh.,ge,c„up,ed: device, o, CMOS imager for generaUng -<^J!^ 
" th^an image of a su^iect. Typica, CCDS have a .g„^-to..o,s. rauo (SNR, o^^ 

X 60 L a, a partieuiar exposure sening, Beca.se the CCD exposure ™y ^ 
elged o.y op a .r «ame ,or siower, hasis, the dypamre 

i. limited to the 60 dB range. By carefuUy designing *e correlated ^"^'^^ 
Ir^«y (CDS, and automa,ic.gain.on,ro, circuitr,- .AGO, and hy nsmg a i.» no.» 
To^^^digita, convener (ADC, the noise in the output wiU tend to he domm^J. 
,Ke CCD noise and no, that of .he CDS, AGC and ADC eieetronre crcu.try. Therefore. 
lO-bit ADCs are adequate for typical CCD applications. 

A IChit ADC. however, limiu the dyn^ic.tange resulting in poor co„tn.st and 
color depth in cenain prcures or v^ fteids. for exampie. when » 
.mlnanl hetween a hrigh, por^on and a dar. portion inchK-ed in a v^ J^J^^ 
1^, U is dimcult to adjust the gain to pick up both the dale ponton ^ 

„ ^der proper exposure conditions. If the gain U adjusts, to .he dark p^m™, 
Thngh, portion appears washed out. On the other hand, if the expos^e condrhons 
^ adjusted » the bdght portion, the daric portion appears black. 
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Co«v»W AGCS include conuol circui., at»mp.s » adjmt 

.„»™aca», ^ »a.o. i-in .PPU«i " *e -o. image » 

,0 use *e ~ ^. of ^= ADC. whieh . W .he 
™s .unmade adjusunen. is sene^'v ^-d upon vaHou. .n«ge a™ne«« 
r ^ .ave».ed" ov» . sin^e .-ne » -pie frames. Once *e anaio. rn^ 
Z^^^ digiU^ '.y <^ ADC, U,e AGC wii, generally also deunn,ne whe^. 
Tanalog gain adjuanne™ haa been e,rec,ive .o udli. *e ^11 signal p™ »ge 
::ra:i-a,.ainisapp.ied,o,l.ed.giu^i.nageda,a.„lnc„ase.e^..^^^^ 

Signal ,„me Mlrange of U>. DSP ci,cui,n-. in d,is way, convennon^ AOCs a»np.o 
Jvide pe,.f»ne o, pe..n,ul„ple.f«n,e au.o.a.ic gain adjusunen, o,^.n an^og and 
digiud g»ns to increase the btighmess of the image as a whole. 

conventional AGCs. howcvc. ate ineffective in high conn^t situations. For 
^ the cnnttast and colo, depth ptoblem discussed above becomes pa«cuW, 
:Z -.o ove^onte where a subject in the image is inaidea room ^ in ^^o^- 
very bHght baCground, such as a wtndow on a bnght day. ~na, AOCs^ 
I impmve such high contrast images ^ -he AOC '»« J^^^^ 

calculates an "avenge" gain over a .11 frame or mulUple f^e. a^ ^^-^ ^ 
, gain value uniformly to a„ of the pixels in the Unage flame. In.thts scheme^ .f^ 
loc gain is increased to tmprove dre low intensity portions of the tmage. d.e bnght» 
; ,::,„ samrate and appear washed ou. On the other hani if the analog gam . 

.0 get greater contrast in the brighter porU.ns of the image, the low tnt^tty 
portions of the image will get even darker and appear black. 

TO solve dtis contmst problem, pnor approaches have g«.»ally been to adjt.t 
,he exposure control of the CCD to be the best possible contrast or to ince^ .h= 
,^llce Of a mam subject by strobe nashlng. Ano,h» pHor — 
conven the image signal from the CCD into digital information wtd, an ADC. ^ h» 
„ split dte image into a bHght portion and adark portion. These nvo porttons m y 

t processed separately and later recombined befbre processing dte d.gnal p,x.l 
. ^tltlon With d^ta. Sign, processing circuitry (DSP, to provide an analog v,dco 
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output signal. This prior approach, however, is not particularly effective in achieving 
greater resolution or handling high contrast situations. 

What is needed to solve this contrast problem is a new system and approach for 
providing increased dynamic range without losing image information. 

SUMMARY OF THE INVENTION 

TO solve the problems addressed above, the present invention contemplates per- 
pixel gain control to enhance the dynamic range and contrast in the resulting image. 
The presem invention accomplishes this per-p.xel gam control by breaking the mput 
signal range into multiple levels (N). by applying an analog gain (Gl) to each ptxel 
before converting it to digital information, and by applying a. correlating digital ga,n 
(G2) to each pixel after the digital conversion. On a per-pixel basis the total ga.n 
(G1*G2) is kept substantially constant. In this way. the dynamic range of the system is 
increased without increasing the dynamic range of the ADC. 

One embodimem of the presem invention is a per-pixel gain control system for 
i^age processing. This system may include a multiple level segment selector recetvmg 
, pixel analog signals, and having an output signal indicative of asegment withtn whtch 

signals and has multiple selectable gain (Gl) levels; an analog-to-digital converter 
.eceiving amplified analog signals from the analog gain block; a digital gam lock 
receiving digitized data from the analog-to-digital converter and having multtp e 
selectable gain (G2) levels; and a gain selector receiving the output signa^ ft.m the 
ntultiple level segment selector and having gain select output signals applied to the 
analog gain block and the digital gain block on a per-pixel basis. 

In a further embodiment, the combined per-pixel gain of the analog gain (01) 
.0 and the digital gain (G2) may be kept substantially constant, and may in particular be 
substantially equal to the number of levels (N) of the muluple level segment selector. 
. These multiple levels may also be set to evenly divide a range.(R) of the pixel analog 
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.i«»,s .„ . „o„-*«il«l-b«dlm»>, *= N levels for said a^loS Sai" block 
Zla»d«.» . f.,-.,ou,*so^-,»»aU»Ns.MoveU.fors.dd.s„. S«n 
Z: ...... a^se^. 2 ro, , .cond . or a 

Jog sig^l m., include . fi« level ftom 0 » R/4. a s^ond level lro,„ R/4 » R/2, 
Airi level ftom IU2 to 3R/4, and a four* level from 3IV4 to R. 

,„ , ^ embodiment a per-pixel gain comrol s,s»m for image processing 
m.y include segmen«Uo« circuiB, segmenting an analog image signal in» mutaple 
ZL. levels providing a s^men. co„„ol signal indicUve of wS ch segm» 
ell .mongs^dmul^ple se^cn, levels image pUcls fall on a " 
^circuin, applying a.p»-pixe, gain ro .he analog image s,g„al -^^ZIZ 
evds associa^d »i.h each of .he muhiple segmen. levels; an auaio -.o^g.<-^ 
onvcerdigl^ng a„pli.ed analog s,gnals from .e a^log ^-'-^-^^ - 
cir»iny applving aper^ixcl gain ,o .he digitized sights ftom .he ««.og-.o-d.g.^ 
clll l'havinggain levels associated .id, e«hof the mnlUple segmen.^. 
Z gain selecuon crcuitr, receiving the segmen, control signal an. app,« a,g^ 
s.gnai .0 dte an.og gain circm. and the digital 
. ar^log .„„ level (CO and adig.,al gain level (02, associated ».th ^^^"^'^ 
.J -ma^e pixels fall on a per-pixe, hasis. ^ per-pixel ga^ con^l system may 
also include exposure conuol cir»it,y that receives the segment control s,gnal to 
conuol m exposure semng for a ch»ge.coopled device imager. 

« embodiment of ^ presen. invention is also a method for improving *e 
avnamic range in images by dividing an analog image input range ,nto mu^^ 
„ determining within which segm«,. imagepixels fall on a p»-p.xe^ - • 
applyin. to ea* image pixel an analog gain level (Ol, .d.p.n.em upon the se^e« « 
I h each image pixel Ms; converting a^log image pixel i^-matron ..t 
3. image pixel information;, and applying to each image pixel a dr^ui ga.n level (02 
lUn. upon the segment in which each image pixel falls, in th.s med,o , the 
Ham lie. (On and .he digital gain level (02, may be applied so ^ a,otal ga.n 
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• ■ ^ m hp substantially constant, for all image 
of Ol times G2 s maintained to be suDStanumij 
for each pixel of Gl times uz . be selected by choosing a desired 

Pixels ma further step, a level of enhancement may be selecte 
ntunber (N) of segments into which to divide said analog image input 

, .-^erembodimentofthepresentin.en.on.^^^^^^ 

^ control system in an image processing ^^^^^^ . 
gain selector having an analog output gain selecting signal 
Loggainhloc.andamultiplelevel.gi..m^^^^^^^ 
selecting signal communicating with a digital gain block^ Ea g 

selecting sign, dependent ^ X:;::^ ^ ^ 

...the 

cooperate to provide a subsian y ^^^^^^ 
n^ultiple level analog gain selector and the multiple level digital g 
select gain levels for groups of image pixels. 

Related to this fiirther embodiment is a method for selecting, analog and digital 

TOs method includes selecting for an image pixel an ar. g g ^^^^^ 
. 3,nal level of the image pixel, and selecting f. th^m.^^^ x^^^^ ^^^^ 
dependent uponthe Signal level ofthe imagepixel. msn^^^^^^y^^ 
gain levels for each image pixel within an image signal, and may 
for groups of image pixels within an image signal. 

BRIEF DESCRIPTION OT THE DRAWINGS 

...benotedthattheappendeddrawingsillustrateonlypanicularemb^^^^^^ 

0, the Ltion and are, therefore, not to he considered limiting of its scope, for 
inventionmayadmittoothereffectiveembodiments. 

FIG 1 is a bloc, diagram of an image processing system including a per-pixel 
1 a with N-level analog and digital gam selectors, 
mevel segment selector, along with N-level ana g 

according to the present invention. 
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no 2 is a block diagram of . 4-l.v.l .e^m™ »le=.or, including multiple 
comp.«»rs. a.o,« «i,h 4-,=v.l analog »,d digiul gain scleco.. wording ,0 U,c 
present invention. 

no. 3 iB a g^phical depiction of a 4.1.V.1 gain elector, accctding to ^ 
p^, inv^don. ^ P"vid« tor the combination of analog gain (01, a.d dtgttal 
gain (02) for each pixel to be substantially constant. 

„ DESCRIPTION OP THE PREFERRED EMBODIMENTS 

The present invention involves assembling a digital sample of d.e pixel a, d.e 
output of dte ADC dtat has a dynamic range higher dtan the analog-to^igh^ com«« 
(ADC, Fo, example, having a pixel dynamic range of .2 bits, eve. though th. ADC 
„■ ..cnlva lO-bittange. This digtta, image stream, having a wider d,n^c ra«^.n»y 
^ b. nutpped non-linearl, into a lO-bit word to ge, a video outp. tmag. wth good 
contrast: 

To accomplish this increased dynamic range wifltout increasing th. ADC «nge, 
„ th. present invenUon ftrst segments the input signal into N.1.V..S. A ftxed ana^g g^ 
IS then applied cor^nding to the level associa»d with the signal to _ the 
signal at le input of the ADC. Next, the gain is adiusted on a pixel.by-p». ba.s so 
that each pixel is m„l«pU«i by the appropdate gain needed to place tt ,n» t^ ADC s 
full input signal range (R,. The M-bi, output of dte ADC is dten mapped mu> a (M^^ 
, lo.,N) bit digiul word. the»h, increasing the dynamic n»ge by (log=N, b,ts. 
■ distal samples ma, .h«, be mapped bade into a. M-bit (o, odter size) word usmg non- 
„1 ntapphtg such as a logaritWc transfer ^cdon. « this point, a vanety o 
^„ curves may be digitally applied based on the image chara— ^ 
^in, tnav also be done .tor the dau has been convened into ROB (red-green-blue. 
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•n« iofonn»ion .bo« signal level .Iso pn,vid.s a ready meaxs of 
c^g-ehis^snm of^ Unage, This .nay be used-.c deunnine 0. gain semng 
f„, .laconic exposure co„«,l of a charge-coupled, device (CCD, unager. The 
.:^su,e C0h».l of *e CCD «ould: sdU be done oh a ft.n,e.»,y.f».= basis us,^ 
«^s>ics about U« fame. Aitt«,ugh *e discussion below ,ela..s primarily .0 CCD 
i^. ^ present invention is also applicable to CMOS imagers and other imagers 
that provide image signal infonnation. 

Referring to FIG. 1, a block diagram is provided of a system, according to the 
p^sent inventiott, for e^ancing contrast and dynamic range of ^i^iUzed ovaput^m a 
CCD m system 100, CCD 102 receives an image from its visual frame. The CCD 
processes this image and provides analog output signals representing pixel data wuhm 
the visual frame of CCD 102. The- analog output of CCD 102 is then processed by 
correlated double sampling (CDS) circuitry 104. ll.e analog gain block 1 16 apphes a„ 
analog gain to the output of CDS 104, and the output of the analog gain block 116 .s 
digitized by the ADC 120. Digital gain block 118 then applies a digital gatn to the- 
digitized data, and this digital, information is ultimately processed by digital stgnal 
processing (DSP) circuitry 124 to produce a video output signal. 
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,„ a convendonal image processmg system, a gain and control 
circuitry would r«=eive digitized image data fmm dte output of d,e ADC. The gain and 
exposure control cin=uit,y would then use this digital infonnation average! over . p«. 
l^. or per-multiple-ftame basis to set the exposure level of the CCD and to set *e 
gain appUed by the analog gain block and dte digital gain block. If the avenge ptxcl 
d,u in the vi^tal ftame of CCD ^r. too bright or too dart the gain and exposure 
contm, circuit,, would attempt to compensate by automadcally adjusting the exposure 
^ on CCD and the gain appliedby analog g«n blodc 1 16. In addition, the garn 
and exposute control circuitry of a conventional system would «»ly« the output of *e 
ADC to detemnn. ifth. automatic analog gain control had be«, effective in talcmg 
advantageof the full processing range of thesystem. If not, an appropriate digital gam 
would b. wiiad t. the digitized dat. by. the digital gain block. In conventtonal 
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Th. »v»Uo,. .s depicted in ,he enbodunen, in FIG. 1, provides a p«. 

, pixe, gain »ii»s«.«.. .ha. enhances dyna^c .ange in a.e vide, o»,pu, signal. As 
rjp,a«d h, ^ inven.ion, .he anaio. gain hioe. and .he^...^ 

H«k U. .« ,oged,» .o provide a, subsranrially consran, per-prxe, ^ »iu* 
^s .he dynan-ic of dre s,s»n, »id.o„. re,uUing an ^rease h. d« d^c 
range of the ADC 120. 

TO aeeomplish d^s advantageous resuh, d,e pi.el analog signals are Ors, broken 
i„„„„i«ples.gn,en,sbyanN..eve,segn,en.sel.«orUO. lnod«rwords.if *e«nge 
:d«si^»-COS10.is.n.0,o.CN-lev..seg..en..,.e».n«v»^h^ 
a» »,ge in,o R/N segments, where N is d,e enhaneemen. factor desned. Fo^ ^ 
„ log pixel s.gn^, the N-leve, segment selector UO detennl^s ^.«.th.n.th..^ 

*e - °»" "It. 

dlr^ination. it provides an «.coded segntent co«rol word^ 
detertninadon to N-leve, analog g«n selector 1 12 and N-level dlgtul gatn sele«or 14^ 
Th speeded word is also provtd^l to exposure control lOS. which tna, »t.l^ ^ 
It^ation to det^tine the appropriate f^e exposnre for the CCD 102 For the 

plsent invendon. dterefore. dtere is no need for an additio.»l cental crctry to 

previde pixel informadoo .0 d.e exposure control block lOS. 

Based «p«. the encoded word ftom segment selector 1 10. analog gain selector 
„ U2 acts to s.l«.d,. gain level (01) for analog gain block 116. Analog gain block 1 1^ 
^ be d^ .0 have N selecuble levels, wilh each level be.g assocated w,* 
analog .gnal s.gn»„.. The g.n (G„ for .e d,.ere„, levels ma, be . uo be 
N« wh». S repres^tts the segment number from 1 to R The analog gatn (01) 

pixel signal may be. sheeted to be WS^. whe„ S„, is dte segment number 
30 within which the pixel signal fell. 
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• " Similarly, based upon the encoded word from segment selector no, di^^^^ 
selector lU acts to set the gain level (G2) for digital gain block 118. Digital gain block 
,18 mav also be designed to have N selectable levels, with each level being associated 
with separate analog signal segment. The gain (G2) for the different levels may be set 
, to be N/Gl, where 01 represents the analog gain applied to a particular pixel pnor to .ts 
being digitizedby ADC 120. ^ digital gain (01) for a given pixel signal, therefore 
would be equal to the segment number S,.„. in which the analog pixel signal feU 
(G2=N/01=N/(N/S,„.)=S.„.). The gain (02) is applied to the pixel signal after u has 
been digitized by the ADC 120. 

The analog gain (Gl) and the digital gain (G2) combine- to provide a gain for 
each pixel that is substantially constant and equal to the number of segments ^) m» 
which the output signal from CDS 104 is broken (G1-G2=N). For a M-bU ADC 120 
the enhancement achieved is (Log.N) bits, and the dynamic range at the output of 
„ digital gain block 1 1 8 is (M . Log.N) bits. Thus, the number of segments (N) may be 
selected to achieve a desired enhancemem and increased dynamic range. 

The gain (Gl) applied by analog gain block 1 16 is adjusted such that any given 
pixel signal is preferably not pushed out of the range (R) of the ADC 120. Thus. smaU 
.0 pixel signals are provided with a relatively large gain as compared to large p.xel 
Signals, once ADC 120 converts the analog pixel signals into digital .nformanon 
digitalgainblockll8appliesasecondgain(G2)forthepixelsignals. The gam (02) 

p^vided by digital gain block 118 ensures that G2=N/01, and thereby that O 02-R 
Thus, small analog pixel signals that received a large gain from analog gam block 16 
« will receive a smaU gain from digital gain block 118. Similarly, large analog p.xel 
signals that received a small gain from analog gain block 116 will receive a large gam 
from digital gain block 1 18. In this way, the present invention provides pixel-by-p.xel 
N-times gain enhancement at the output of digital gain block 1 1 8. 

The output of digital gain block 118, which has dynamic range of (M - Log.N) 
bits, may be reduced by a non-linear compander 122 to a lower number of b.ts for 
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by DSP .24.ii„o ..vid~ o«pursig.».. ™. comp»din. ma, Iso be-donc 
i,„yd.stelstt8e»i<l>i"*«DSP mocaitertteDSP 124. 

„ is «.»d to the o«pu. Signd fton, the digital gain block IIS ™ay b= 
p™»»«l » dcsi^d before eo„veni.g U,e digi.! infonnaUon into a video ou,pu. 

U .so „o»d to N-leve, anaios ^ seieao, 112 and N-leve, d.^ul ga. 
sel. ..4n-, be combined in.o a single ope— bloc, o, .a, be sepa»»d n^ 
„,„ to. t^oopennional blocks. The pu„»se or gain s=l»=».s »^ " ^ 
a,gain.e«l.for gain block. 1.6 and 118. 1. is l^be, need to alto^ *e 
deplc^d : no. . bas ,be same n„n,be, gaU, levels s.,ec»d b, ^n 
selects 1.2. and IH as seg^en. =.a.ed in segmen, se.ec.0, .10, *e nnmber o 
selectable gain levels do not have to be identical to the n„.be, of segtnenu. and analog 
^^inblock .16 nta. b.ve a diffetent nnmbet of selectable gain levels to. .gt,al.g«« 
bio* .18. Finally. 1, is noted to tbe analog segtnentatlon of tbe in»ge ana^og^g^ 
be accontplisbed at a desitedplacc on *e an^og side of the systetn. «.d does not, 
have to be taken from the output of CDS 104. 
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Metring nov to ITIG. Z. a. fb«he, etnbodhnen. of the ptesent invention . 
..piccd in which a 4.,ev=l segtnentation has been in.ple.„=nted. h. the descttptton of 
Z. . above. . is „o» 4. and fo. gain .evels have been chosen f..r gatn bu.- > • 
^.i ,18 The 4-,evel segment S.lector202 receives the analog pixel stgna. fiom CDS 
704 Thispi«Ulgnalisas.medtohaveaslgna..ange,^mOtoR.w.thRbe.„. .he 

(R) of the ADC .20. To breaU the pUel signal range into 4 segments, segm™ 
let , 02 ma, include three comparators 204. 206. and 208. Comparator 2 4 t^^ 
, „.ive the analog pi«, sign, and compare i, to a leva, of 1,4<R). omp^tor 2« 
receive the analog pixe. signal and compare it to a level »t 
comparator 208 may receive the analog pixel signal and compare it to a leve, of 
The oatputs of comparators 204. 206 and 208 may then be provided to an encode, 2 . a 
in thclbodiment sh„v» in HG. 2. e.^ 210 provides a 2-bit word tnd.cat.ngm 
30 which ofthe four segment the pixel fell. 
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Analog gain selector 212. and digital gain selector 214 use this 2-bit word to 
select the appropriate gain levels for the pixel signal. Because the analog pixel signal ts 
being broken into 4- segments, the total gain provided to each pixel will be times 4. 
(G1*G2^) regardless of the segment in which the pixel falls. For example, tf the 
s pixel signal is below 1/4(R). the analog gain selector 212 will select a gain of times 4 
(x4) for analog gain block (Gl) 1 16. Once that pixel signal is digitized, for example 
into a 10-bit word by a 10-bit ADC 120, digital gain selector 214- will select for the 
same pixel a gain level of times 1 (xl) for digital gain block (G2) UZ. T,. total gam 
«ceived by the pixel signal is times 4 (x4). Similarly, a pixel level between 1/4(R) and 
.0 1/2(R) will receive an analog gain of x2 and a digital gain of x2. A pixel signal 
between 1/2(R) and 3/4(R) will, receive an analog gain of x(4/3) and a digital gam of 
x3 Finally, a pixel signal above 3/4(R) will receive an analog gain of xl and a digital 
gain of x4. Thus, any given pixel will always receive a gain equal to Gl •G2-N-4. 

Accordingly, the dynamic range is increased by 2 bits (Log,N=Lofe4=2). For a 
,0-bit ADC 120. therefore, the dynamic range is increased from 10 bits to 12.bits. The 
SNR. however, would still be limited to below 60 dB. assuming it is dominated by the 
CCD's output. Although the present invention does not improve the SNR, it. does- 
increase dynamic range, which results in a much more pleasing image. 

Referring now to FIG. 3, a diagram is providedthat graphical depicts a 4.1evel 
gain selector, such as associated with the embodiment depicted in FIG. 2. The input 
signal level ranges linearly from 0 to R for the analog pixel signal, with R representing 
the range (R) of the ADC 120. The input signal level is provided at the bottom of FIG. 
„ 3 Dotted line 306 represents a graphical division between the digital gain (G2) region 
304 which is above dotted line 306, and the analog gain (Gl) region 302, which is 
below dotted line 306. The input signal is broken into four segments 312, 314, .16, 
and 318. 

■„ segm™. 312 (S^-O. inpu. ,ign1 levels ™ge from » » 1/4(R). The analog 
gain (Gl) is x4, yielding an after gdn signal level n»ge 6om 0 » IR, which is shown 
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♦ vielding an after gain, signal 

to.lm.g.ofO,o HL Th.>o»lgain(GI-G2)is,imesfo«(N-l). 

, ^ gain (G.) « X2, yielding » ato gain signa, lev., ,a.g= torn 1^<R) 

:JiL».^nG.3. TH.aigi.i gai„(G2, i„ s=g..n.3,4is . ..^»a«» 
gato »gn.. level nu-ge of IR .0 2R. The ,.,a, gain (G,-G2, i= umes fb„r (N-4). 

,„ seg»en, 3,6 (5^,-3), inP». *nal levels »nge .0„ l/2(^) » 3/4^)^T^ 
„ analog gain (Gl, is x(4/3,. yielding an after gain si^l level ™g. 6™ ^'CR) 
J^L^^^C. T.edigi.a,s.in(02,inseg„en.3..i,.x3 
^i.signallev=l«ngeof2R»3R. The io-al g^n <0. .G2, is «mes fo» (N^). 

,n segn,e„ 31S ,^4), inp. signal levels »«e fto„ ^^■') '"-^^^^ 
^alog gain (Gl) is xl. yieldlng an aft«: gain signal level »«e: Son.. 3/4<R) <o IR.. 
:::i:s..linnc.3-. T.edigi..galnCG«tos.g.nen.3,,isx4 .^.ng^»- 
^nsign^level»ngeoOR»4.t The»Mgain(G..G2)is«Mesf.n,(N-4, 

Th„. ,he «s„l. of a 4.i.vel g»n seleoo, (G,.G2-4) as depic»di„ F,G. J'isio 
.^ance *. pe,.pi». analog signal range fron, 0-R » <MR On. d„ '^'f 

rori2o. : . - - 

^ce^iing *e nmge of ADC 120. «hich wonld result in sainraung ADC 120 and 
Z^L. -^ color infonna-ion. On ,.e digiu. side of ADC ,20. ihe per-p.„, 
Z IS .ven enough g^n .0 n.a. .he »»1 gain e,- .0 - 
loh ^ ^ an^log Signal «as spli. For .he en,hodi.en. d=p,ered ,n HG. 
FIG 3 and a lO-bi. ADC 120. U,e normal lO-bU dynanne range of .mage 

, J u o K;tc tn a 12-bit dynamic range, 
processtog sy5t«n has been enh«Ked by 2-b..s .0 12 b ' ^ 
Signiircanay. mepresen. invention has acoomplished d.s b, prov,d»g a per.p.xel ga.n 

selection. 

■ TO sunw-arize for ,he N-4 level segmen, selector, the input signal leva, fi»n, 
CDS ,04 is first checlcedby a scries of comparators, and a two-bit segtnen. sdecto, 
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an ».i.g is aPPii^^ •» '"P- " ™" 
^p. ™s is iU«s».d in FIG. 3. A. ,h. ou.pu, of *e ADC, .„ .pp™pn,.d,g^ 

, p„*«of U« two gains (0,.<32, is e,«a, ,0 *= d.i,=.o..«,I 

Lge I. FIG. 2 a™. FIG. 3. .his ovcraii incaase is .imcs 4 or 2-b... The full 12.b,. 
Jal ^ ^ ba co„.pa„dad down >o iO b,» by using a .ogarid^ic. curve or son« 
oL dasL .anafer characertsdc in compander 122. In edition, as s»,e<l above, 
aide benel. » .he seg.en.,ion provided in segment s^eo«.r ,10 is d». U» 
^ informadon ™ay b. used ,o create a histogram ofdte image, which ma, be ^ 
I exposure control bloc. 108 to compute a slowly varying gain for the eleetronre 
exposure control. 

Funher modifications and alternative embodim«.ts of this invendon wiU be 
,. apparent to those. sluUed in the art in view of this deacripd™. Acco,di"g^*» 
" Iripdonis to be, construed. as iUustradve only a.^ is for the purpose of ^ 
U,ose.,.illed i„ the an the manner of carrying out the invendon. It .a to beunde^^. 
,h.r *= forms of d« invendon herein shown anddeseribed are to be taken as presently 
embodiments. B,uivalent elements may be substituted —11 u^^ 
L described herein, and c»tain fea„»=a of d,e invention may ^ » = 
independeotl, of d» use of oU,er features. ^1 as would be apparent to one s^Ued ,n the, 
art after having the benefit of dria description of d.e invention. 
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WHAT IS CLAIMED IS: 

1 A per-pixel gain control system for image processing, comprising: 

• altiplelevelsegmentselectorreceivingpixelanalogs.gnals.andh^^^^^ 

output signal indicative of a segment .ithin which each pixel falls on a 

per-pixel basis; 

an analog gain block receiving pixel analog signals and having multiple 

selectable gain (Gl) levels; 
» ,™log....ii8iul convener r»=ivi„B an-pliW a»3lo, signals fton. s«d 

analog gain block; 
, di<,M block rccivine digiu^a d.» liom said a»log-«»iigiul 
■ conv=™, a.d having multiple s.l=ctableg«»(G2)l=vds:a™i 

a gain se,«or receiving said ou.pu. signal from said mnltipl. l-d sea»«» 

sel«o», and having gain select output signds applied u, satd «»log g«n 
block and said digital gain block on a per-pi«l basis. 

, Theper-pixel gaincontol systemofdaim ,„He,ein. combined pet-pixel gain 
'of said analog gain (G„ and said.digital g»n (G2) is s»bs.««ially constant. 

f-.u5m7 wherein said combined per-pixel 
The per-pixel gain control system of claim 2, wherem s 

gain is subsliall, e,ua. to tbe number of leve. (N, of said multiple level seg„».t 

selector. 

4 Tb.pe,-pi.elgai»con..olsys.emofc,^m3.»h.teinsaidmultip.elev.lsof , 
. lmulUp,:ieve.seg„».ts.lectota.cs.t,o.v.„lydivid.atange«fo,sa,dpt«el 

analog signals. 

5. The per-pixel gain control system of claim 4. wherein said analog gain block 
and said digital gain block each has N gain levels. 



15 



20 



30 



6.. Theper-pixelgaincontrolsystemofclaim5,whereinNis4. 
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7. Thc-.per^pixel gain control system of claim 6. wherein said analog-to-digital 
converter is a.lO-bit device. 
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« n^e per-pixel gain control system of claim 6, wherein said N gain levels for saad 
. analog gain block, are times 4 for a first segment, times 2 for a second segment, umes 
4/3 for a.third segment., and times 1 for a.fourth segment; and wherein said N ga.n 
levels for said digital gain block are times I for a first segment, times 2 for a second 
segmenu times 3 for a third segment, and times A for afourth segment. 

9 The per-pixel gain control system of claim 3, wherein said N multiple levels of 
said pixel analog signals are four levels, and include a first level ftom 0 to R/4, a 
second level from R/4 to.R/2. a third level from Ry2 to 3R/4.. and a fourth level from 
3R/4to R. 

A per-pixel gain control system for image processing, comprising: 
segmentation circuitry segmenting an analog image signal into multiple 
segment levels and providing a segment control signal indicauve- of 
which segment level among said multiple segment levels image: pixels 
fall on a per-pixel basis; 
analog gain circuitry applying a per-pixel gain to said analog image signal and 
having multiple gain levels with at least one of said multiple gain levels 
associated with each of said multiple segment levels; 
an analog-to-digital converter digitizing amplified analog signals from said 

analog gain circuitry; 
digital gain circuitry applying a per-pixel gain to said digitized signals from said 
. analog-to-digital converter and having multiple gain levels with at least 
one of said multiple gain levels associated with each of said multiple 
segment levels; and 

gain selection circuitry receiving said segment control signal and applying a 
gain selection signal to said analog gain circuitry and said digital, gam 
circuitry to choose said at least one analog gain level (Gl) and said at 
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least one digital gain level (G2) associated with said segment level in 
which image pixels fall on a per-pixel basis. 
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The per-pixel gain control system of claim 10. wherein said.multiple segment 
levels, said multiple analog gain levels, and said multiple digital gain levels are, an 
equal number (N)- 

12 The per-pixel gain control system of claim 10, wherein a combined per-pixel 
gain of said analog gain level (Gl) times said digital gain level (G2) is maintained 
substantially constant on a per-pixel basis. 

13 The per-pixel gain control system of claim 10, wherein said segmentation 
circuitry includes a plurality of comparators to determine a. segment level for each said 
image pixel. 

14 The per-pixel gain control system of claim 10, further comprising exposure 
control circuitry receiving said segment control signal to control an exposure setting for 
a charge-coupled-device imager; 
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A method for improving dynamic range in images, comprising: 

dividing an analog image input range into multiple segments; 

detemiining within which segment of said multiple segments image pixels fall 

on a per-pixel basis; 
applying to each said image pixel an analog gain level (Gl) dependent upon 

said segment in which each said image pixel falls; 
converting analog image pixel information into digital image pixel information; 
and 

applying to each said image pixel a.digital gain level (G2) dependent upon sa.d 
segment in which each said image pixel faUs. 
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,6 Th. m«hod-Of cl«m 15. -hcto =na.og gain l.v., (G„ »d said digiui 
^ ^ (02) app.l«i » a .o», gain fo, each pi», of G. Un,« 02 » 
mantaintito be subsantially conslam for aU image pixels. 

, ,7 TlKm«h«lofcUiml5,furmercomp,isingse,ec,ingalevei«f«0«»=eme«by 
choo^ig ..dcs».d nun.be, (N) of segnienu in,o whid. ,o divide said analog in»g. 



input. 
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18 The method of claim 17, further comprising providing as many selectable 
analog gain levels as said desired number (N). and providing as many selectable d.gttal 
gain levels as said desired number (N). 

,9 The method of claim 18. further comprising applying said analog gain level 
(Gl) and said digital gain level (G2) so that a combined gain of Gl times G2 is satd 
desired number (N). 
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A per-pixel gain selector for a gain control system in an image processing. 

system, comprising: . " 

a multiple level analog gain selector having an analog output gam selecting 
signal communicating with an analog gain block, said analog output 
gain selecting signal being dependem upon an image signal on a per- 
pixel basis; and 

a multiple level digital gain selector having a digital output gain selecting signal 
communicating with a digital gain block, said digital output gam _ 
selecting signal being dependent upon an image signal on a per-pixel 
basis. 



21 The per-pixel gain selector of claim 20, wherein said multiple level analog gam 
selector and said multiple level digital gain selector cooperate to provide a substantially 
,0 constant combined per-pixel gain of said analog gain and said digital gain. 
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n The per^xd gain .t claim 21, where,. »id muitipie level ^o, W^ 

seleeto, s«d mulUple level digiui gain se,e«or each sel«:« ftom a «me »«mber of 

gain levels (N)- 

, 23. mper-pixelgainselectorofclaim22,whereinsaidcombinedper-^^^^ 
substantially equal to said number of gain levels (N). 

24 The per-pixel gain selector of claim 1 0, wherein said multiple level analog gain 
selector and said multiple level digital gain selector select gain levels for groups of 
10 image pixels. 

25. Amethodforselectinganaloganddigitalgainlevelstoapplytoanimagesignal 
to improve dynamic range in resulting images, comprising: . , 

selecting for an image pixel an analog gain level dependent upon a s.gnal level 
- of said image pixel; and 

»,=c,i„g for aaid in»ge pixel . digi^l depe«l».- "pon »d .gnal 

level of said image pixel. 

26 The n»*od of clain, 25, whe^in ^ «»-og ^ leve, and said digira, gain 
„ ,e»l .re selec^d » a »«1 gain .dr each pixel is n»in»ined ,o be aub«an„ally 
constant for all image pixels. 

27. The method of claim 25, wherein both selecting steps are done for each image 
pixel within an image signal. 

" 28. The method of claim 25, wherein both selecting steps are done for groups of 
image pixels within an image signal. 
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4-LEVEL GAIN SELECTOR (Gl x G2 4) 




INPUT SIGNAL LEVEL (0-lR) 



Figure 3 
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